DESCRIPTION
Senior Data Engineer
Optum, the fast-growing part of United
Health Group, is a leading information and technology-enabled health
services business. Our teams are dedicated to modernizing the health
care system and improving the lives of people and communities.
Serving virtually every dimension of the health system, we work with a
diverse set of clients across **Apply on the website** countries -
from those who diagnose and treat patients to those who pay for care,
deliver health services, and those who supply the cures. Optum
maintains operations across North America, South America, Europe, Asia
Pacific and the Middle East. Our innovative partnerships provide
technology and tools that enable unprecedented collaboration and
efficiency.
As a result, we can tap into valuable health care data to uncover
insights and develop strategies for better care at lower costs. As
part of this team, you will be empowered to analyze data, create
solutions and build production-ready models. Join us! There&#**Apply
on the website**;s never been a better time to do your life&#**Apply
on the website**;s best work
Primary
RESPONSIBILITIES:
* Design and build data pipelines (mostly in Spark) to process
terabytes of data
* Orchestrate in Airflow the data tasks to run on Kubernetes/Hadoop
for the ingestion, processing and cleaning of data.
* Create Docker images for various applications and deploy them on
Kubernetes
* Design and build best in class processes to clean and standardize
data.
* Troubleshoot production issues in our Elastic Environment
* Tuning and optimizing data processes
* Work on Proof of Concepts for Big Data and Data Science
* Modelling of big volume datasets to maximize performance for our BI
& Data Science Team
* Create real-time analytics pipelines using Kafka / Spark Streaming
You&#**Apply on the website**;ll be rewarded and recognized for your
performance in an environment that will challenge you and give you
clear direction on what it takes to succeed in your role as well as
provide development for other roles you may be interested in.
Required
QUALIFICATIONS:
* Undergraduate degree in Computer Science or relevant field
* Proven experience of developing processes in Spark
* Hands on experience of writing complex SQL queries
* Building ETL/Data Pipelines
Preferred
QUALIFICATIONS:
* Exposure to Kubernetes and Linux containers (i.e. Docker) for at
least 1 year
* Related/complementary open source software platforms and languages
(e.g. Scala, Python, Java, Linux)
* Exposure to the following technologies:
Airflow, Hive /HBase / Presto Jenkins / Travis, Kafka, Cloud
technologies:
Amazon AWS or Microsoft Azure
* Previous experience with Relational Databases (RDBMS) & Non
- Relational Database
* Analytical and problem-solving experience applied to a Big Data
environment and Distributed Processing.
* Experience working in projects with agile/scrum methodologies
* Exposure to DevOps methodology
* Data warehousing principles, architecture and its implementation in
large environments
Please note you must currently be eligible to work and remain
indefinitely without any restrictions in the country to which you are
making an application. Proof will be required to support your
application.
Careers with Optum. Here&#**Apply on the website**;s the idea. We
built an entire organization around one giant objective; make the
health system work better for everyone. So, when it comes to how we
use the world&#**Apply on the website**;s large accumulation of
health-related information, or guide health and lifestyle choices or
manage pharmacy benefits for millions, our first goal is to leap
beyond the status quo and uncover new ways to serve.
Optum, part of the United
Health Group family of businesses, brings together some of the
greatest minds and most advanced ideas on where health care must go in
order to reach its fullest potential. For you, that means working on
high performance teams against sophisticated challenges that matter.
Optum, incredible ideas in one incredible company and a singular
opportunity to do your life&#**Apply on the website**;s best work.
SM
Diversity creates a healthier atmosphere:
United
Health Group is an Equal Employment Opportunity/Affirmative Action
employer and all qualified applicants will receive consideration for
employment without regard to race, color, religion, sex, age, national
origin, protected veteran status, disability status, sexual
orientation, gender identity or expression, marital status, genetic
information, or any other characteristic protected by law.
- provided by Dice
Position: ?Senior Data Engineer - Dublin/ Letterkenny, Ireland
DESCRIPTION
Senior Data Engineer
Optum, the fast-growing part of United
Health Group, is a leading information and technology-enabled health
services business. Our teams are dedicated to modernizing the health
care system and improving the lives of people and communities.
Serving virtually every dimension of the health system, we work with a
diverse set of clients across **Apply on the website** countries -
from those who diagnose and treat patients to those who pay for care,
deliver health services, and those who supply the cures. Optum
maintains operations across North America, South America, Europe, Asia
Pacific and the Middle East. Our innovative partnerships provide
technology and tools that enable unprecedented collaboration and
efficiency.
As a result, we can tap into valuable health care data to uncover
insights and develop strategies for better care at lower costs. As
part of this team, you will be empowered to analyze data, create
solutions and build production-ready models. Join us! There&#**Apply
on the website**;s never been a better time to do your life&#**Apply
on the website**;s best work
Primary
RESPONSIBILITIES:
* Design and build data pipelines (mostly in Spark) to process
terabytes of data
* Orchestrate in Airflow the data tasks to run on Kubernetes/Hadoop
for the ingestion, processing and cleaning of data.
* Create Docker images for various applications and deploy them on
Kubernetes
* Design and build best in class processes to clean and standardize
data.
* Troubleshoot production issues in our Elastic Environment
* Tuning and optimizing data processes
* Work on Proof of Concepts for Big Data and Data Science
* Modelling of big volume datasets to maximize performance for our BI
& Data Science Team
* Create real-time analytics pipelines using Kafka / Spark Streaming
You&#**Apply on the website**;ll be rewarded and recognized for your
performance in an environment that will challenge you and give you
clear direction on what it takes to succeed in your role as well as
provide development for other roles you may be interested in.
Required
QUALIFICATIONS:
* Undergraduate degree in Computer Science or relevant field
* Proven experience of developing processes in Spark
* Hands on experience of writing complex SQL queries
* Building ETL/Data Pipelines
Preferred
QUALIFICATIONS:
* Exposure to Kubernetes and Linux containers (i.e. Docker) for at
least 1 year
* Related/complementary open source software platforms and languages
(e.g. Scala, Python, Java, Linux)
* Exposure to the following technologies:
Airflow, Hive /HBase / Presto Jenkins / Travis, Kafka, Cloud
technologies:
Amazon AWS or Microsoft Azure
* Previous experience with Relational Databases (RDBMS) & Non
- Relational Database
* Analytical and problem-solving experience applied to a Big Data
environment and Distributed Processing.
* Experience working in projects with agile/scrum methodologies
* Exposure to DevOps methodology
* Data warehousing principles, architecture and its implementation in
large environments
Please note you must currently be eligible to work and remain
indefinitely without any restrictions in the country to which you are
making an application. Proof will be required to support your
application.
Careers with Optum. Here&#**Apply on the website**;s the idea. We
built an entire organization around one giant objective; make the
health system work better for everyone. So, when it comes to how we
use the world&#**Apply on the website**;s large accumulation of
health-related information, or guide health and lifestyle choices or
manage pharmacy benefits for millions, our first goal is to leap
beyond the status quo and uncover new ways to serve.
Optum, part of the United
Health Group family of businesses, brings together some of the
greatest minds and most advanced ideas on where health care must go in
order to reach its fullest potential. For you, that means working on
high performance teams against sophisticated challenges that matter.
Optum, incredible ideas in one incredible company and a singular
opportunity to do your life&#**Apply on the website**;s best work.
SM
Diversity creates a healthier atmosphere:
United
Health Group is an Equal Employment Opportunity/Affirmative Action
employer and all qualified applicants will receive consideration for
employment without regard to race, color, religion, sex, age, national
origin, protected veteran status, disability status, sexual
orientation, gender identity or expression, marital status, genetic
information, or any other characteristic protected by law.
- provided by Dice
We need : English (Good)
Type: Permanent
Payment:
Category: Others
